Embedded authentication systems in an electronic device

ABSTRACT

This invention is directed to an electronic device with an embedded authentication system for restricting access to device resources. The authentication system may include one or more sensors operative to detect biometric information of a user. The sensors may be positioned in the device such that the sensors may detect appropriate biometric information as the user operates the device, without requiring the user to perform a step for providing the biometric information (e.g., embedding a fingerprint sensor in an input mechanism instead of providing a fingerprint sensor in a separate part of the device housing). In some embodiments, the authentication system may be operative to detect a visual or temporal pattern of inputs to authenticate a user. In response to authenticating, a user may access restricted files, applications (e.g., applications purchased by the user), or settings (e.g., application settings such as contacts or saved game profile).

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/386,707, filed Apr. 17, 2019, which is a continuation of U.S. patentapplication Ser. No. 15/470,752, filed Mar. 27, 2017, which is acontinuation of U.S. patent application Ser. No. 15/357,873, filed Nov.21, 2016, which is a continuation of U.S. patent application Ser. No.14/142,669, filed Dec. 27, 2013, which is a continuation of U.S. patentapplication Ser. No. 12/207,374, filed Sep. 9, 2008, which claims thebenefit of U.S. Provisional Patent Application No. 60/995,200, filedSep. 24, 2007, the entire contents of which are incorporated herein byreference in their entirety.

This application is related to the following applications: U.S. patentapplication Ser. No. 14/142,657, “Embedded Authentication Systems in anElectronic Device,” filed Dec. 27, 2013, now U.S. Pat. No. 9,134,896,issued Sep. 15, 2015; U.S. patent application Ser. No. 14/142,669,“Embedded Authentication Systems in an Electronic Device,” filed Dec.27, 2013; and U.S. patent application Ser. No. 14/142,674, “EmbeddedAuthentication Systems in an Electronic Device,” filed Dec. 27, 2013,now U.S. Pat. No. 9,038,167, issued May 19, 2015, which are incorporatedherein by reference in their entirety.

BACKGROUND OF THE INVENTION

This invention is directed to electronic devices with embeddedauthentication systems.

Electronic devices, and in particular portable electronic devices, areused to store personal information. For example, users may use cellulartelephones, PDAs, smart phones, or other electronic devices to storecontacts, e-mail, calendar information, documents, and other informationused by the user. While this information may not necessarily beconfidential, users may desire that at least some of that information beunavailable to other people. One approach for preventing unauthorizedpeople from accessing and viewing the user's personal information may beto require users of the electronic device to provide a password or passcode prior to enabling device functions or accessing device resources.For example, the electronic device may require a user to enter a fournumber or four letter pin prior to displaying the device home screen(e.g., a spring board) or menus. As another example, an accessory devicefor detecting a user's fingerprint or for scanning a user's retina maybe coupled to the device such that the user must first show anauthorized fingerprint or retina before receiving access to the device.

While both of these approaches may be useful, restricting access basedon a password or pass code is effective only so long as no other userknows the password or pass code. Once the password or pass code isknown, the restriction mechanism may become ineffective. Also, apassword or pass code may be forgotten, thus locking an authorized userout of the device. In addition, requiring a user to provide afingerprint or submit to a retina scan may be time consuming andbothersome for the user, requiring an additional step before the usercan access the device. While this approach is more secure than enteringa password or pass code, it comes at a cost in hardware (e.g., thenecessary scanner, detector, or reader) and time. It would be desirabletherefore, to provide an electronic device by which biometric and otherauthentication mechanisms are implemented in the device such that thedevice authenticates the user quickly and seamlessly, for example as theuser turns on, unlocks or wakes the device.

SUMMARY OF THE INVENTION

Methods, electronic devices and computer readable media forauthenticating a user of an electronic device are provided. In someembodiments, an electronic device may seamlessly authenticate a user.The electronic device may receive an input from a user, the inputprovided by an input mechanism of the electronic device. The electronicdevice may detect identification information as the user provides theinput from one or more sensors embedded in or adjacent to the inputmechanism. The electronic device may authenticate the user by comparingthe detected identification information with identification informationstored in a library of the device. For example, the sensor may include asensor for detecting features of a user's skin, or features underneath auser's skin. The sensor may be embedded in at least one of a touchscreen, a button (e.g., of a keyboard or mouse), device housing near aninput mechanism (e.g., laptop housing near keyboard), or any othersuitable location.

In some embodiments, the electronic device may determine that a user isaligned with a sensing component of the device without directing theuser to align with the sensing component. For example, the sensingcomponent may be positioned such that the sensing region of the sensorincludes expected positions of the user while the user operates theelectronic device. The sensor may detect one or more biometricattributes of the user (e.g., facial or eye features) using the sensingcomponent. For example the sensor may include a camera or optical sensorlocated adjacent to a display of the device. The user may then beauthenticated by comparing the detected biometric attributes with alibrary of biometric attributes stored by or accessible to theelectronic device.

In some embodiments, the electronic device may authenticate a user basedon common attributes of options selected by a user. The electronicdevice may display several selectable options for selection by the user,and may receive a user selection of a subset of options. The electronicdevice may then identify one or more attributes common to some or all ofthe selected option. The attributes may include, for example at leastone of, size, color, contour, fill pattern, shape, alignment with otheroptions, the position of an option relative to other options, the sourceof the option, or any other suitable attribute. The electronic devicemay then authenticate the user based on the identified attribute. Forexample, if the user has selected all of the shapes sharing an attributeassociated with a particular user, the electronic device mayauthenticate the user.

In some embodiments, the electronic device may authenticate a user basedon a pattern of inputs received by the device. The electronic device mayinclude a sensor operative to detect several inputs provided by a user.For example, the sensor may include an input mechanism operative toreceive inputs provided by a user. As another example, the sensor mayinclude an accelerometer or gyroscope operative to detect motion of orcontacts with the electronic device. The electronic device may beoperative to identify a pattern of the detected inputs, and to comparethe identified pattern with patterns stored in memory to authenticatethe user. The patterns may include temporal patterns (e.g., related tothe delays between consecutive inputs), visual patterns (e.g., relatedto attributes of several options selected by the user or inputs providedby the user), or combinations of these. Upon authenticating the user,the electronic device may provide the user with access to restrictedelectronic device resources.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects and advantages of the invention will beapparent upon consideration of the following detailed description, takenin conjunction with the accompanying drawings, in which like referencecharacters refer to like parts throughout, and in which:

FIG. 1 is a schematic view of an illustrative electronic device for usewith an authentication system in accordance with one embodiment of theinvention;

FIG. 2 is a schematic view of an illustrative display screen of anelectronic device in accordance with one embodiment of the invention;

FIG. 3 is a schematic view of an illustrative display screen directing auser to authenticate in accordance with one embodiment of the invention;

FIG. 4 is a schematic view of an illustrative display screen fordirecting a user to authenticate prior to accessing device resources inaccordance with one embodiment of the invention;

FIGS. 5A-C are schematic views of illustrative display screensassociated with different users provided in response to authenticatingthe user in accordance with one embodiment of the invention;

FIG. 6 is a schematic view of an illustrative electronic device displayfor detecting a user's fingerprint in accordance with one embodiment ofthe invention;

FIG. 7 is a schematic view of another illustrative electronic device fordetecting a user's fingerprint in accordance with one embodiment of theinvention;

FIGS. 8A and 8B are schematic views of an illustrative electronic devicefor detecting a user's handprint in accordance with one embodiment ofthe invention;

FIG. 9 is a schematic view of an illustrative electronic device fordetecting a user's hand print in accordance with one embodiment of theinvention;

FIG. 10 is a schematic view of an illustrative device having a sensoroperative to detect features underneath a user's skin in accordance withone embodiment of the invention;

FIG. 11 is a schematic view of an illustrative electronic device havinga sensor for detecting features of a user's face in accordance with oneembodiment of the invention;

FIG. 12 is a schematic view of an illustrative electronic device havinga sensor for detecting features of a user's eyes in accordance with oneembodiment of the invention;

FIGS. 13 and 14 are schematic views of an illustrative display forproviding a visual pattern in one embodiment of the invention; and

FIG. 15 is a flow chart of an illustrative process for authenticating auser in accordance with one embodiment of the invention.

DETAILED DESCRIPTION

An electronic device having an authentication system for restrictingaccess to electronic device resources is provided. Access to anysuitable electronic device resource may be restricted, including forexample access to files or data stored on or available to the device. Asanother example, access to particular applications may be restricted(e.g., applications purchased by particular users, or applicationsassociated with administrative tasks or privileges). As still anotherexample, access to personal settings (e.g., displayed options,background images, or the icons used for applications) may be restricteduntil the user authenticates.

Any suitable authentication system may be implemented. In someembodiments, the authentication system may include a system fordetecting biometric features or attributes of a user. For example, theelectronic device may include a system operative to detect andauthenticate a user based on features of or under a user's skin, such asa finger print, hand print, palm print, knuckle print, blood vesselpattern, or any other suitable portion of or under the user's skin. Asanother example, the electronic device may include a system operative todetect and authenticate a user based on features of a user's eyes orface, or movements of the user's eyes. As still another example, theelectronic device may include a system operative to detect features of auser's ear canal, an odor associated with the user, a user's DNA, or anyother suitable biometric attribute or information associated with auser.

In some embodiments, the authentication system may include a systemoperative to identify a user based on a visual or temporal pattern ofinputs provided by the user. For example, the electronic device maydisplay several selectable options or shapes forming a visual pattern.The user may select any suitable predetermined subset of displayedoptions to authenticate. For example, the user may select one or moreoptions that have a predetermined attribute (e.g., size, color, shape orcontour) in common. As another example, the user may select one or moreoptions positioned in predetermined areas of the display (e.g.,independent of the attributes of the selected options). The user mayselect options simultaneously, sequentially, or as a combination ofthese.

As another example, the user may provide a series of inputs at aparticular pace or in a particular pattern. For example, the user mayselect options with a particular delay (e.g., pause between twoselections). Alternatively, the user may provide inputs detected by asensor (e.g., an accelerometer or a gyroscope) of the device following apredetermined temporal pattern. The device may detect the inputs fromvibrations caused by tapping the device or an area adjacent to thedevice, moving the device in a particular manner, or any other suitableapproach for detecting inputs.

The electronic device may provide any suitable combination ofauthentication systems, including for example biometric authenticationsystems and pattern-based authentication systems, several biometricauthentication systems, or several pattern-based systems. In someembodiments, different authentication systems may be associated withdifferent resources, such that a user may provide authenticationinformation for several systems before finally accessing particularrestricted resources (e.g., private or personal information). Theelectronic device may use any suitable approach for selecting whichauthentication systems to combine. For example, a user may associateseveral authentication systems with particular resources, or theelectronic device may instead automatically (e.g., as a default) assignparticular authentication systems to particular resources.

FIG. 1 is a schematic view of an illustrative electronic device for usewith an authentication system in accordance with one embodiment of theinvention. Electronic device 100 may include processor 102, storage 104,memory 106, communications circuitry 108, input/output circuitry 110,authentication system 112 and power supply 114. In some embodiments, oneor more of electronic device components 100 may be combined or omitted(e.g., combine storage 104 and memory 106). In some embodiments,electronic device 100 may include other components not combined orincluded in those shown in FIG. 1 (e.g., a display, bus, or inputmechanism), or several instances of the components shown in FIG. 1. Forthe sake of simplicity, only one of each of the components is shown inFIG. 1.

Processor 102 may include any processing circuitry operative to controlthe operations and performance of electronic device 100. For example,processor 102 may be used to run operating system applications, firmwareapplications, media playback applications, media editing applications,or any other application. In some embodiments, a processor may drive adisplay and process inputs received from a user interface.

Storage 104 may include, for example, one or more storage mediumsincluding a hard-drive, solid state drive, flash memory, permanentmemory such as ROM, any other suitable type of storage component, or anycombination thereof. Storage 104 may store, for example, media data(e.g., music and video files), application data (e.g., for implementingfunctions on device 100), firmware, user preference information data(e.g., media playback preferences), authentication information (e.g.libraries of data associated with authorized users), lifestyleinformation data (e.g., food preferences), exercise information data(e.g., information obtained by exercise monitoring equipment),transaction information data (e.g., information such as credit cardinformation), wireless connection information data (e.g., informationthat may enable electronic device 100 to establish a wirelessconnection), subscription information data (e.g., information that keepstrack of podcasts or television shows or other media a user subscribesto), contact information data (e.g., telephone numbers and emailaddresses), calendar information data, and any other suitable data orany combination thereof.

Memory 106 can include cache memory, semi-permanent memory such as RAM,and/or one or more different types of memory used for temporarilystoring data. In some embodiments, memory 106 can also be used forstoring data used to operate electronic device applications, or anyother type of data that may be stored in storage 104. In someembodiments, memory 106 and storage 104 may be combined as a singlestorage medium.

Communications circuitry 108 can permit device 100 to communicate withone or more servers or other devices using any suitable communicationsprotocol. Electronic device 100 may include one more instances ofcommunications circuitry 108 for simultaneously performing severalcommunications operations using different communications networks,although only one is shown in FIG. 1 to avoid overcomplicating thedrawing. For example, communications circuitry 108 may support Wi-Fi(e.g., a 802.11 protocol), Ethernet, Bluetooth™ (which is a trademarkowned by Bluetooth Sig, Inc.), radio frequency systems, cellularnetworks (e.g., GSM, AMPS, GPRS, CDMA, EV-DO, EDGE, 3GSM, DECT,IS-136/TDMA, iDen, LTE or any other suitable cellular network orprotocol), infrared, TCP/IP (e.g., any of the protocols used in each ofthe TCP/IP layers), HTTP, BitTorrent, FTP, RTP,

RTSP, SSH, Voice over IP (VOIP), any other communications protocol, orany combination thereof.

Input/output circuitry 110 may be operative to convert (andencode/decode, if necessary) analog signals and other signals intodigital data. In some embodiments, input/output circuitry can alsoconvert digital data into any other type of signal, and vice-versa. Forexample, input/output circuitry 110 may receive and convert physicalcontact inputs (e.g., from a multi-touch screen), physical movements(e.g., from a mouse or sensor), analog audio signals (e.g., from amicrophone), or any other input. The digital data can be provided to andreceived from processor 102, storage 104, memory 106, or any othercomponent of electronic device 100. Although input/output circuitry 110is illustrated in FIG. 1 as a single component of electronic device 100,several instances of input/output circuitry can be included inelectronic device 100.

Electronic device 100 may include any suitable mechanism or componentfor allowing a user to provide inputs to input/output circuitry 110. Forexample, electronic device 100 may include any suitable input mechanism,such as for example, a button, keypad, dial, a click wheel, or a touchscreen. In some embodiments, electronic device 100 may include acapacitive sensing mechanism, or a multi-touch capacitive sensingmechanism. Some sensing mechanisms are described in commonly owned U.S.patent application Ser. No. 10/902,964, filed Jul. 10, 2004, entitled“Gestures for Touch Sensitive Input Device,” and U.S. patent applicationSer. No. 11/028,590, filed Jan. 18, 2005, entitled “Mode-Based GraphicalUser Interfaces for Touch Sensitive Input Device,” both of which areincorporated herein in their entirety.

In some embodiments, electronic device 100 can include specializedoutput circuitry associated with output devices such as, for example,one or more audio outputs. The audio output may include one or morespeakers (e.g., mono or stereo speakers) built into electronic device100, or an audio component that is remotely coupled to electronic device100 (e.g., a headset, headphones or earbuds that may be coupled tocommunications device with a wire or wirelessly).

In some embodiments, I/O circuitry 110 may include display circuitry(e.g., a screen or projection system) for providing a display visible tothe user. For example, the display circuitry may include a screen (e.g.,an LCD screen) that is incorporated in electronics device 100. Asanother example, the display circuitry may include a movable display ora projecting system for providing a display of content on a surfaceremote from electronic device 100 (e.g., a video projector). In someembodiments, the display circuitry can include a coder/decoder (Codec)to convert digital media data into analog signals. For example, thedisplay circuitry (or other appropriate circuitry within electronicdevice 100) may include video Codecs, audio Codecs, or any othersuitable type of Codec.

The display circuitry also can include display driver circuitry,circuitry for driving display drivers, or both. The display circuitrymay be operative to display content (e.g., media playback information,application screens for applications implemented on the electronicdevice, information regarding ongoing communications operations,information regarding incoming communications requests, or deviceoperation screens) under the direction of processor 102.

Authentication system 112 may include any suitable system or sensoroperative to receive or detect an input identifying the user of device100. For example, authentication system 112 may include a skin-patternsensing mechanism, an optical system for identifying users based ontheir facial patterns, eye features (e.g., retinas), or vein patterns,or any other sensor for detecting any other unique biometric feature orattribute of a user. As another example, authentication system 112 maybe operative to receive secret or confidential entries identifying theuser (e.g., gestures on the device, or touching a particular pattern ofobjects or colors on a display). As still another example,authentication system 112 may be operative to detect particularmovements or vibrations of the device caused by the user. Authenticationsystem 112 may be combined or embedded in any other element ofelectronic device 100 (e.g., a display or a camera), or use eventsdetected by various sensors of the electronic device (e.g., anaccelerometer or proximity sensor). In some embodiments, several typesof authentication systems may be combined or implemented in theelectronic device.

In some embodiments, electronic device 100 may include a bus operativeto provide a data transfer path for transferring data to, from, orbetween control processor 102, storage 104, memory 106, communicationscircuitry 108, input/output circuitry 110 authentication system 112, andany other component included in the electronic device.

To prevent unauthorized access to data or information stored in memoryor storage, the electronic device may direct an authentication system toidentify the user and authorize access to requested resources. Theelectronic device may require authorization prior to providing access toany electronic device resource. In some embodiments, the electronicdevice may require different levels of authorization before providingaccess to different applications or different data or files associatedwith different applications. For example, the electronic device mayrequire a user to satisfy several authentication systems prior toproviding access to an application or data (e.g., a secondaryauthentication, for example using biometrics, in addition to a first orinitial authentication, for example a pass code used to unlock thedevice).

FIG. 2 is a schematic view of an illustrative display screen of anelectronic device in accordance with one embodiment of the invention.Display screen 200 may be displayed in response to a user unlocking theelectronic device. Display screen 200 may include selectable options 210for accessing various device functions. For example, each option 210 maybe associated with different applications available on the electronicdevice. As another example, each option may be associated withparticular data or files available to the user. The electronic devicemay or may not require authentication to access display 200. Forexample, display 200 may include basic or default applications availableto the user. As another example, display 200 may include defaultfeatures available to all users.

In some embodiments, one or more applications may provide access to oruse data or resources that are personal to one or more users. Forexample, options 212 and 214, associated with telephone and mailapplications, respectively, may involve personal accounts or contactsthat are not associated with every user of the electronic device. Priorto providing access to such applications, or to personal or confidentialfeatures or resources available via such applications, the electronicdevice may require the user to authenticate. In some embodiments,default features of applications may be available without authentication(e.g., allow all users to place telephone calls, but not to access acontact list).

FIG. 3 is a schematic view of an illustrative display screen directing auser to authenticate in accordance with one embodiment of the invention.Display screen 300 may be displayed in response to receiving aninstruction from a user to access resources (e.g., information or anapplication) restricted by an authentication protocol. Display screen300 may include information 310 associated with the selected resources.To prevent an unauthorized user from viewing the resources prior toauthorization, information 310 may be blurred or hidden from view (e.g.,entries in particular field may be unobtainable). In some embodiments,display screen 300 may instead include no information until the user isauthenticated.

Display screen 300 may include notice 320 instructing the user toauthenticate before accessing the requested resources. Notice 320 mayinclude a pop-up, overlay, new display screen, or any other suitabletype of display for providing an instruction to the user. Notice 320 mayinclude any suitable instruction, including for example a manner inwhich the user is to authenticate (e.g., specifying a particularauthentication system to use). For example, notice 320 may direct theuser to provide a fingerprint or provide an input that matches apredefined visual or temporal pattern. Once the user authenticatesproperly, the electronic device may display information 310 in a mannerdiscernable by the user, and enable selectable options or otherfunctions associated with the selected resource.

In some embodiments, a user may be required to authenticate prior tounlocking the electronic device (e.g., prior to accessing any resourceof the device). FIG. 4 is a schematic view of an illustrative displayscreen for directing a user to authenticate prior to accessing deviceresources in accordance with one embodiment of the invention. Displayscreen 400 may include option 410 for unlocking the display. Forexample, option 410 may include a slider operative to be dragged acrossa portion of the screen. As another example, option 410 may include anoption or series of options for the user to select (e.g., simultaneouslyor sequentially press several keys or touch several areas of displayscreen 400).

Display screen 400 may include notice 420 directing the user toauthenticate prior to accessing the device resources (e.g., the homescreen from which information and applications are launched). Notice 420may include any suitable type of notice, including for example a pop-up,overlay, new display screen, or any other suitable type of display forproviding an instruction to the user. The electronic device may displaynotice 420 at any suitable time, including for example when the userturns on the device (e.g., and views display screen 400), in response tothe user attempting to access device resources without firstauthenticating (e.g., as an error message), in response to a userrequest for help, or at any other suitable time. Notice 420 may includeany suitable instruction, including for example a manner in which theuser is to authenticate, a list of authorized users, or any othersuitable information.

Once the user has been properly authenticated, the electronic device maydisplay options associated with the authenticated user (e.g., optionsfor applications purchased by particular users). In some embodiments,the electronic device may provide access to resources or content thatwas previously not available (e.g., contact lists or previous messagesin a telephone or mail application). FIGS. 5A-C are schematic views ofillustrative display screens associated with different users provided inresponse to authenticating the user in accordance with one embodiment ofthe invention. Display screen 500A may include several options 510A. Thedisplayed options may include some options common to a default or basicdisplay of the electronic device (e.g., display screen 500A sharesoptions with display screen 200, FIG. 2). Display screen 500A mayinclude several options 512A for additional applications or resourcesonly available to the particular authenticated user. For example,display screen 510A may include additional options 512A for game, systemand media applications.

Display screen 500B may include options 510B for resources orapplications available to the users. In some embodiments, options 510Bmay be entirely different from the options of a default screen (e.g.,display screen 500B shares no options display screen 200, FIG. 2).Display screen 500B may be further customized to not include labelsidentifying the applications or resources associated with options 510B.

Display screen 500C may include options 510C for resources orapplications available to the users. In some embodiments, options 510Cfor the same resources as other display screens may have differentappearances (e.g., different icons). For example, in FIG. 5C, theoptions displayed for the Mail, Clock, Photos, YouTube, and Calculatorapplications may be different than those displayed in display screen500A of FIG. 5A. Display screen 500C may in addition include a custom orpersonal background 512C (e.g., different background image). In someembodiments, display screen 500C may not include a dock or other featurefor maintaining some options 510C in a fixed position (e.g., unlikeoptions 510B located in dock 512B).

In some embodiments, the electronic device may provide access todifferent amounts of electronic device resources based on the identityof the authenticated user. For example, if an electronic device is usedby several users (e.g., parents and children in the same family), theusers may share some but not all of the resources (e.g., all users mayhave access to the family contact list, but not to other family members'e-mail). As another example, users of the electronic device may beorganized in groups or tiers of users. Some resources may be associatedwith groups or tiers or users, instead of or in addition to particularusers. When a particular user is authenticated and identified as beingpart of a group, the electronic device may provide the user with accessto the resources associated with the group (e.g., common or sharedcontacts, shared communications, or shared documents) and to theresources associated with the particular user (e.g., personal contacts,e-mail accounts, and telephone call lists).

The electronic device may associate particular resources with one ormore authentication systems. For example, a user may identify a resourceand provide a protect or secure instruction (e.g., by selecting anappropriate option). A user may in addition select one or moreauthentication systems to satisfy before providing access to theresource. If the resource is not public (e.g., not a default applicationor file to remain available to all users), or if the resource wascreated or purchased by the user, the electronic device may associatethe selected resource with the one or more selected authenticationsystems. Alternatively, if the user has sufficient privileges (e.g., anadministrator), any resource may be secured using one or more selectedauthentication systems.

The electronic device may not require a user to authenticate each timethe user unlocks or operates the electronic device. In some embodiments,the electronic device may allow a user to authenticate for a particularamount of time. For example, once authenticated, the electronic devicemay allow a user to access restricted resources for 10 hours from thetime the user authenticated. As another example, the electronic devicemay retain the user's authentication for a particular amount of timeafter having received the user's last instruction or having entered astand-by mode (e.g., retain authentication for thirty minutes after aninput). The amount of time the electronic device retains authenticationinformation may be set by the device or by the user, and may be based onthe particular types or resources protected by the authenticationinformation (e.g., allow for a longer authentication period for accessto a game purchased by a particular user than to a user's personalcontacts). Not requiring the electronic device to authenticate each timethe user operates the device may save power consumption.

The electronic device may use any suitable type of authentication systemto prevent unauthorized access of device resources. In some embodiments,the electronic device may include an authentication system based on auser's unique skin patterns. For example, the electronic device mayinclude an authentication system operative to detect a user's finger,hand, palm, knuckle print, or any other suitable print or skin featureunique to the user. The authentication system may include a sensoroperative to detect the user's unique skin pattern or feature.

The sensor may include any suitable type of sensor for detecting uniquefeatures or patterns of a user's skin. For example, the sensor mayinclude an optical scanner operative to detect features of the user'sskin. The optical sensor may include a charge coupled device, or anyother suitable array of light-sensitive components (e.g., diodes)operative to record the light received by the sensor (e.g., a chargecoupled device). For example, if a charge coupled device includes anarray of light-sensitive components, the optical sensor may be operativeto record, for each light sensitive component of the array, a pixelrepresenting the light received by the particular light sensitivecomponent. The value of each pixel may then reflect the distance fromthe sensor of the particular portion of the user's skin associated withthe pixel (e.g., a ridge or valley). The recorded pixels may form animage, for example of a particular portion of the user's skin, that theelectronic device can compare to a library of images associated withauthorized users.

As another example, the sensor may include a capacitive sensor operativeto detect features of a user's skin. The capacitive sensor may includeone or more chips containing an array of cells, each of which mayinclude at least two conductor plates separated by an insulating layer.The sensor may be coupled to an inverting amplifier operative to changethe voltage between the at least two conductor plates of each cell inthe chip. When a user's finger is placed over the array of cells, thesensor may be operative to distinguish the cells over which a valley(e.g., a fingerprint valley) and a ridge (e.g., a fingerprint ridge) areplaced from the different capacitance values of each cell (i.e., cellsunder a valley will have a lower capacitance than cells under a ridge).Using the detected capacitance values of each cell in the chip, thesensor may generate an image or a representation of the skin placed overthe sensor that can be compared to a library of images orrepresentations available to the electronic device.

The authentication system may include any suitable countermeasure forpreventing an unauthorized user from spoofing an authorized user's skinpatterns, for example by placing an image (e.g., a printed image) or athree-dimensional structure (e.g., a polymer cast) adjacent to theauthentication system sensor. For example, the authentication system mayinclude a combination of optical and capacitance sensors, a sonar orradio-frequency sensor, a sensor for detecting a user's pulse, a heatsensor for determining the temperature of the object placed against thesensor (e.g., to determine if the temperature is within a range ofexpected human skin temperatures), or any other suitable countermeasure.

The sensor may be operative to detect features of the user's skin usingany suitable approach. In some embodiments, the sensor may be operativeto detect features of the user's skin when the user's skin is moved overthe sensor. For example, the sensor may include a one-dimensional sensoror stagnant sensor (e.g., a line of sensing components) operative todetect features of a user's finger as it slides or rolls over thesensor. The sensor may include an orientation in which the user's skinis to move to provide an accurate representation of the user's skinfeatures. For example, the sensor may require a user to move a fingertipalong the axis of the finger or perpendicular to the axis of the finger.

In some embodiments, the sensor may be operative to detect features ofthe user's skin when the skin is held immobile over the sensor. Forexample, the sensor may include a two-dimensional sensor or movingsensor operative to detect features of the user's finger when the fingeris stationary over the sensor. The sensor may be operative to move at aregular pace or speed under the user's immobile finger, or detect aninstantaneous or near-instantaneous two-dimensional representation ofthe user's finger at a point in time (e.g., as the user's finger movesover the sensor). Using a two-dimensional sensor may provide a moreaccurate representation of the user's skin features, as atwo-dimensional sensor does not depend on the user moving his skin overthe sensor at a regular or even pace, unlike a one-dimensional sensor.

The sensor may be placed at any suitable location within the electronicdevice. In some embodiments, the sensor may be placed such that it isoperative to detect an appropriate portion of the user's skin as theuser operates or begins to operate the electronic device. The sensorposition may vary based on the portion of the user's skin to be detected(e.g., finger, hand or palm). FIG. 6 is a schematic view of anillustrative electronic device display for detecting a user'sfingerprint in accordance with one embodiment of the invention. Display600 may include screen 602 instructing the user to unlock the electronicdevice. For example, screen 602 may include block 610 having an arrowinstructing the user to slide block 610 along track 612 to unlock theelectronic device, for example by placing a finger on block 610 anddragging the finger along track 612.

To authenticate the user during the unlocking process, display 600 mayinclude sensor 620 in the display along track 612. For example, sensor620 may be embedded in the display stack (e.g., among the display stackthat may include a capacitance sensing component, a light source, and adisplay surface). As another example, sensor 620 may be placedunderneath the display stack. As still another example, sensor 620 mayinclude an existing component of the display stack (e.g., the displaystack for a touch screen display may include a capacitance sensor). Insuch an approach, the authentication system may use the detected outputof a capacitance sensing component of the display stack (e.g., in atouch screen display) that has a sufficient resolution fordistinguishing ridges and valleys of a user's skin. In some embodiments,the capacitance sensing component of the display stack may includeseveral types or densities of capacitance sensing components to allowfor authentication using particular portions of the display (e.g., usevery fine sensing components in the display stack along at least aportion of track 612 for authentication and less fine sensing componentsin the remaining areas of display 600).

In some embodiments, sensor 620 may be embedded in the electronic devicesuch that it is not visible in display 600. For example, sensor 620 maybe assembled, printed or etched directly on display 600 (e.g., etched onglass) such that the user cannot see the fingerprint scanner. If a userhas difficulty providing a suitable fingerprint to sensor 620, display600 may highlight the outlines of sensor 620 (e.g., display an icondirecting the user to place a finger on the icon over sensor 620) toassist the user in authenticating.

FIG. 7 is a schematic view of another illustrative electronic device fordetecting a user's fingerprint in accordance with one embodiment of theinvention. Electronic device 700 may include input mechanisms 710 and712 that the user may actuate to provide inputs to electronic device700. For example, input mechanism 710 may include a keyboard, and inputmechanism 712 may include a touchpad or track pad. It will beunderstood, however that any other input mechanism, including inputmechanism remotely coupled to electronic device 700 (e.g., a wired orwireless mouse) may be used with electronic device 700.

To provide for secure access to resources, electronic device 700 mayinclude at least one sensor 720 operative to detect features of a user'sfingerprint to identify the user. To provide a seamless user experience,the sensors 720 may be embedded in or under at least one of inputmechanism 710 and 712. In some embodiments, input mechanism 710, whichmay include several distinct keys that a user may press to provideinputs to electronic device 700, may include a sensor 720 embedded inone or more keys. For example, an optical or capacitive sensor may beplaced at the top surface of a key such that when a user places a fingeron the key (e.g., rests his index fingers on the “F” or “J” keys), thesensor may detect features of the user's fingertips for authenticatingthe user. A two-dimensional or moving sensor may be used for thisimplementation to authenticate the user while the user's fingers areplaced over the keys.

A sensor 720 may be placed in, adjacent to or behind any button or otherphysical input that a user may press in an electronic device. Forexample, a sensor 720 may be placed behind a ‘home button of a portablemedia player or cellular telephone (e.g., button 812, FIG. 8B). Sensor720 may be placed between an outer cover or surface (e.g., a glass orplastic surface) and a mechanical component operative to interact with aswitch or electronic circuit. For example, a fingerprint sensingmechanism may be embedded underneath a transparent surface operativethrough which the sensing mechanism may detect a user's fingerprintridges and valleys. In some embodiments, no additional transparentsurface may be necessary (e.g., if the sensing mechanism includes asurface on which a user may place a finger).

In some embodiments, input mechanism 712 may include a sensor 720embedded underneath some or all of the pad such that when a user placesa finger on input mechanism 712 (e.g., to move an indicator on display715), sensor 720 may detect the features of the user's finger forauthenticating the user. Sensor 720 used may be a one-dimensionalsensor, authenticating the user as the user moves his fingers across thepad, or a two-dimensional sensor operative to authenticate the user whenthe user's finger is immobile on the pad (e.g., when the user firstplaces his finger on the pad). Sensor 720 may cover the entire surfaceof input mechanism 712 such that the user need not place his fingersover a particular portion of input mechanism 712 to be authenticated.Electronic device 700 may be operative to identify the position of eachsensor 720 to assist the user in providing an adequately detectableinput, for example using a highlight, indication on the display, or anyother suitable approach. In some embodiments, any other suitable inputmechanism may include a sensor 720 operative to seamlessly detect theuser's fingerprint features (e.g. a button, wheel, key or screen).

FIGS. 8A and 8B are schematic views of an illustrative electronic devicefor detecting a user's handprint in accordance with one embodiment ofthe invention. Electronic device 800 may include housing 802 operativeto retain display 810. Housing 802 may substantially constitute the backsurface of electronic device 800 (e.g., the surface that does notinclude display 810) to protect the components of the electronic device.When a user holds electronic device 800, the user's hand 830 may becupped around housing 802 leaving display 810 visible such that at leastthe user's palm 832 is placed against back surface 804, as shown in FIG.8B. Electronic device 800 may include sensor 820 embedded in backsurface 804 and operative to detect features of a user's palm or hand.By placing sensor 820 on back surface 804 (or any surface of theelectronic device that is opposite the surface of display 810), sensor820 may authenticate the user when the user holds electronic device 800.Sensor 820 may include a two-dimensional sensor, thus allowingelectronic device 800 to seamlessly authenticate the user withoutrequiring the user to move or slide a hand against back surface 804.

FIG. 9 is a schematic view of an illustrative electronic device fordetecting a user's hand print in accordance with one embodiment of theinvention. Electronic device 900 may include input mechanism 910 withwhich a user may provide inputs to the device. Input mechanism 910 maybe positioned such that a user's fingers are placed over input mechanism910 while the user's palms and wrists are placed on or extend overhousing 912. Electronic device 900 may include one or more sensors 920embedded in or placed on housing 912 to authenticate a user of thedevice. Sensors 920 may be located such that the user's hands, palms orwrists are aligned with sensors 920 when the user places his hands overhousing 912 to operate input mechanism 910. Sensors 920 may be operativeto detect features of the user's skin when the user's hands are placedover housing 912, for example using a two-dimensional sensor.

In some embodiments, the authentication system may instead or inaddition include a sensing mechanism for detecting features underneath auser's skin. For example, the authentication system may include a sensoroperative to detect the pattern of a user's veins, arteries, follicledistribution, or any other suitable feature underneath the user's skinthat may be detected. The sensor may include any suitable type ofsensor, including for example an optical sensor (e.g., a camera) locatedon the surface of the electronic device. The sensor may be positioned soas to detect a feature underneath any suitable portion of the user'sskin when the electronic device is in use. For example, the sensor maybe positioned to detect features underneath a user's skin in an area ofthe user's fingers, hand, wrist, arm, face, or any other suitable area.

FIG. 10 is a schematic view of an illustrative device having a sensoroperative to detect features underneath a user's skin in accordance withone embodiment of the invention. Electronic device 1000 may includeinput mechanism 1010 located on or extending through a portion ofhousing 1012. Input mechanism 1010 may be configured such that when inuse, a user's hands and wrists are placed over housing 1012 (e.g.,instead of over input mechanism 1010). Electronic device 1000 mayinclude sensor 1020 operative to detect features underneath a user'sskin. For example, sensor 1020 may include an optical sensor operativeto detect a user's vein patterns near the user's wrists. Sensor 1020 maybe located on any suitable surface of electronic device 1000, includingfor example on or embedded in housing 1012 such that the user's wristsmay be adjacent to sensor 1020 when the user's hands are positioned toprovide an input using input mechanism 1010. Such a positioning mayallow for a seamless authentication of the user by detecting featuresunderneath the user's skin (e.g., a vein pattern by the user's wrist)while the user operates device 1000.

In some embodiments, the authentication system may instead or inaddition include a sensor operative to detect features of the user'sface. For example, the authentication system may include a sensoroperative to detect radiation emitted or reflected by one or moredistinctive features of the user's face when the user's face is placedopposite the sensor. The sensor may be operative to detect any suitabletype of radiation. For example, the sensor may include a light sensor(e.g., a camera), an infra-red sensor, an ultra-violet sensor, ascanning laser, an ultrasound sensor (e.g., sonar), or any other sensoroperative to detect a desired radiation (e.g., a particular range ofradiation frequencies or periods).

The authentication system may be operative to detect any suitableelement of the user's face. For example, the authentication system mayidentify faces by analyzing the relative to position and size of auser's head, nose, mouth, ears, cheekbones, jaw, or any other attributeof the user's face. As another example, the authentication system mayidentify features of the user's face using a three-dimensionalauthentication system to capture and analyze curved surfaces or depthsof a user's facial features (e.g., contour of eye sockets, chin ornose). As still another example, the authentication system may detectunique lines, patterns or spots of the user's skin (e.g., using skintexture analysis) To enhance or facilitate authentication, combinationsof these approaches may be used.

The sensor for detecting features of the user's face may be located atany suitable position on the electronic device. In some embodiments, thesensor may include a camera or other sensor provided with the electronicdevice for a different purpose (e.g., an embedded webcam for chatting).FIG. 11 is a schematic view of an illustrative electronic device havinga sensor for detecting features of a user's face in accordance with oneembodiment of the invention. Electronic device 1100 may include sensor1120 located adjacent to display 1110 such that the user's face, and thefeatures of interest of the user's face may be aligned with sensor 1120(e.g., in the field of view of sensor 1120) when the user faces display1110 to view or access electronic device resources. In response todetecting a user's face opposite sensor 1120, electronic device 1100 maydirect sensor 1120 to capture and analyze features of the user's face,and compare the analyzed features with a library of features associatedwith authorized users. If an authorized user is detected, electronicdevice 1100 may display or provide access to restricted content 1112 ondisplay 1110.

In some embodiments, the authentication system may instead or inaddition include a sensor operative to authenticate a user based onattributes of the user's eyes. For example, the sensor may be operativeto scan a user's retina, iris or retinal blood vessels to detect uniquepatterns of the user. The sensor may include a light source operative toemit light, for example infrared light, to be reflected by the user'seye and detected by a lens or optical sensor. The sensor may analyze thereceived light to create a representation of the user's eyes that can becompared with a library of authorized user's eyes.

As another example, the sensor may instead or in addition be operativeto detect movements of the user's eyes, for example by tracking theposition and movement of a user's retina, iris, blood vessels, or anyother feature of the user's eyes. Before providing a user with access toelectronic device resources, the electronic device may direct the sensorto detect a predetermined eye movement set up by an authorized user. Forexample, each authorized user may create an eye movement track by movinghis eyes in a particular manner (e.g., up, down, left, right, blink,blink) while looking at the sensor. When a user of the device moves hiseyes in a manner that matches a predetermined eye movement, theelectronic device may unlock the device or provide access to restrictedresources.

The sensor may be located at any suitable position of the device,including for example adjacent to a display or other portion of thedevice that will face the user's eyes (e.g., a position similar to thatof sensor 1120, FIG. 11, which may be used to authenticate a user fromfeatures of the user's eyes). FIG. 12 is a schematic view of anillustrative electronic device having a sensor for detecting features ofa user's eyes in accordance with one embodiment of the invention.Electronic device 1200 may include sensor 1220 located adjacent todisplay 1210 such that the user's eyes may be aligned with sensor 1220(e.g., in the field of view of sensor 1220) when the user faces display1210 to view or access electronic device resources. Using sensor 1220,electronic device 1200 may detect features or movements of a user's eyesto authenticate the user and provide access to restricted deviceresources. In some embodiments, sensor 1220 may be implemented toauthenticate a user based on features of the user's face (e.g., likesensor 1120, FIG. 11).

In some embodiments, the authentication may be operative to authenticateusers based on attributes or qualities of their voices. For example, theauthentication system may be operative to detect a particular voicepitch or voice signature. The authentication system may be textdependent (e.g., the user must say a particular phrase to authenticate,such as “my voice is my passport”) or text independent (e.g., anysuitable words may be said to authenticate the user). In someembodiments, the authentication system may require the user to say asecret password to authenticate, thus requiring both knowledge of theuser's password and the user's voice pitch to properly authenticate. Theauthentication system may include any suitable component forauthenticating a user, including for example a microphone. In someembodiments, the microphone may be primarily used for other purposes(e.g., telephone communications or video conferencing).

In some embodiments, other types of authentication systems may be used.In some embodiments, the authentication system may be operative toidentify and authenticate users from the shape of their ear canals. Forexample, the authentication system may include a sensor (e.g., optical,radar or sonar) operative to detect unique features of a user's earcanal (e.g., shape and length). The sensor may be located, for example,near a speaker of the device (e.g., if the device is a telephone). Insome embodiments, the authentication system may be operative to identifya user based on an odor particular to the user. For example, theauthentication system may include a sensor operative to detect uniqueattributes of the odor of a user's skin or sweat glands. The sensor maybe located at any suitable position on the device, including for exampleat or near an input mechanism (e.g., where the user touches the device).

In some embodiments, the authentication system may be operative toidentify a user based on a DNA sequence. For example, the authenticationmay include a sensor coupled to a processor that is operative to receivea cell having the user's DNA (e.g., from the user's skin or mouth) anddetermine whether a particular DNA sequence is present. The length orvariation in DNA sequence may be selected to both ensure that properauthentication is provided and that the authentication process issufficiently quick (e.g., the entire DNA strand need not be analyzed).The sensor may be positioned at any suitable location on the device,including for example on or adjacent to input mechanisms or othercomponents that a user may touch.

The electronic device may receive biometric information reflectingauthorized users using any suitable approach. For example, when a userselects an authentication system to use with particular deviceresources, the electronic device may direct the user to providebiometric information (e.g., a fingerprint, eye scan, or DNA sequence)to be stored in a library. The electronic device may direct the user toprovide the biometric input using any suitable approach, including forexample using visual cues, audio cues, and highlighting or identifyingthe location of the authentication system sensor. Received biometricinformation stored in the library may be retrieved when a user attemptsto authenticate, and compared to the biometric information provided bythe user. If the provided biometric authentication information matchesinformation stored in the library (e.g., information associated with arequested resource), the electronic device may provide access to arestricted resource. In some embodiments, a similar approach may be usedto receive non-biometric authentication information.

In some embodiments, the authentication system may instead or inaddition not require biometric parameters to provide access toelectronic device resources to users. Although non-biometricauthentication systems may be, in some cases, easier to circumvent thanbiometric authentication systems, the non-biometric authenticationsystems may nevertheless be highly effective and secure. In someembodiments, the authentication system may provide access to electronicdevice resources in response to detecting that a key or token is withina particular distance of the electronic device. For example, a user mayhave a cellular telephone and a computer. One or both devices mayinclude circuitry for detecting that the devices are within a particularrange of each other (e.g., 5 feet so that a user may sit at a desk touse the computer with the cellular telephone in his pocket andauthenticate). When the devices determine that they are in proximity,resources of one or both devices may become available. This approach maybe particularly useful to secure access to static devices while takingadvantage of the fact that a user may keep a portable device on hisperson. This and other embodiments are described in more detail incommonly owned U.S. patent application Ser. No. 11/823,656, filed Jun.27, 2007.

In some embodiments, the electronic device may authenticate a user basedon a particular sequence of inputs provided by the user. For example,the electronic device may require the user to provide an inputcorresponding to a visual pattern provided by the electronic device.FIGS. 13 and 14 are schematic views of an illustrative display forproviding a visual pattern in one embodiment of the invention. Display1300 may include distribution 1310 of options or shapes 1312. Display1400 may include distribution 1410 of options or shapes 1412. Each shape1312 and 1412 may have a different fill pattern (e.g., different lineorientations), color or colors, shape or contour, size (e.g., peripheryor area), proximity to or position relative to other displayed shapes,alignment with other shapes (e.g., select four yellow shapes that form astraight line), source (e.g., shapes representing pictures in aparticular album or library), or any other suitable characteristic.Distributions 1310 and 1410 may include any suitable number anddistribution of shapes, including for example a number of evenlydistributed shapes (e.g., 20 evenly distributed shapes 1310) or aseemingly arbitrary distribution of shapes (e.g., arbitrarilydistributed shapes 1410).

To authenticate, the user may select (e.g., as detected by an inputmechanism or other sensor) any suitable subset of the displayed shapesor options. The subset may include some or all of the shapes that shareone or more attributes. For example, the user may select some or all ofthe shapes that are of a particular color (e.g., all shapes that includea shade of yellow). As another example, the user may select some or allshapes that have the same contour (e.g. all squares). As still anotherexample, the user may select some or all shapes that have a particularattribute in common (e.g., all 5-sided shapes, or all shapesrepresenting pictures associated with a particular album stored by thedevice). As yet still another example, the user may select some or allshapes that include a particular distribution of colors (e.g., shapesthat include a red portion adjacent to a blue portion). Any suitablecriteria or attribute (including combinations of the examples listedabove, such as selecting the top two blue shapes and the bottom twosquare shapes) may be used to select the particular subset of displayedshapes.

Any suitable number of shapes or options may be associated with thesubset to select for authentication. For example, the number of shapesmay be related to the total number of displayed shapes (e.g., select 20%of the displayed shapes). As another example, the number of shapes maybe a fixed number, for example less than five (e.g., so that the usercan simultaneously select all shapes using one hand) or ten (e.g., sothat the user can simultaneously select all shapes using both hands).The number of shapes may be selected to optimize security (e.g., requireenough shapes that it is too difficult to simply guess which shapes toselect).

The user may select the subset of the shapes using any suitableapproach. If a multi-touch display is provided, the authenticationsystem may require the user to simultaneously select all of the shapesused for authentication. As another example, the authentication systemmay allow the user to sequentially select the shapes used forauthentication. The shapes may be selected in an arbitrary or particularorder (e.g., from top to bottom or left to right). As still anotherexample, the authentication system may require the user to provide asingle, moving input (e.g., dragging a finger across the display)selecting only the shapes of the authorized subset. Any other suitableapproach for selecting the subset of shapes may be used.

To avoid having the user always select shapes displayed in the samerelative position on the display (e.g., like entering a numeric passcode using a displayed keypad), the electronic device may change thedistribution of the shapes to select for authentication. Toauthenticate, the user may then identify the shapes that share theattribute associated with the authentication protocol. Because theposition of the shapes used to authenticate may change each time theuser accesses device resources, someone looking over the user's shoulderto see the general distribution of the selected shapes may not be ableto select shapes with the same distribution to authenticate (e.g., thestriped shapes may not be distributed in the same areas of the device).

After each failed attempt at selecting shapes for authentication, theelectronic device may change the distribution of the displayed shapes,or even change the shapes (e.g., use different colors or contours) toprevent an unauthorized user from guessing the proper subset of shapes.The electronic device may lock the device resources after a particularnumber of failed attempts to select the proper subset of shapes. Oncelocked, a user may need to couple the device with a host to re-enablethe device (e.g., couple a mobile device to a fixed device) or useanother authentication system (e.g., a biometric system) to re-enablethe device.

In some embodiments, rather than selecting particular shapes, the usermay simply select the shapes located in pre-determined portions of thescreen. For example, the user may place one or more fingers over severalshape positions independent of the actual displayed shape. As anotherexample, the user may place one or more fingers over particular shapesdisplayed by the electronic device, and move the one or more fingers ina predetermined manner (e.g. slide one or more fingers), independent ofthe displayed shapes. As still another example, the user maysuccessively select several shapes located at predetermined positions onthe display (e.g., select shapes at particular locations to form apredetermined pattern).

The electronic device may, in some embodiments, provide a blank oruniform display on which the user may draw one or more patterns usingone or more fingers. Such an approach may confuse or distractunauthorized users by creating a visual distraction via the displayedshapes.

In some embodiments, the electronic device may authenticate a user basedinstead or in addition on a received temporal pattern of inputs by theuser. For example, the user may provide a particular number of inputs ata particular rate to authenticate. The electronic device may detect theinputs using any suitable approach. For example, the electronic devicemay detect inputs provided using an input mechanism of the device (e.g.,inputs received by a touch screen). As another example, the electronicdevice may detect inputs from motion, contacts, vibrations or otherimpacts detected by an appropriate sensor of the device (e.g., anaccelerometer). In such an approach, a user may tap any portion of thedevice (or a body in contact with the device, such as a table on whichthe device is placed) such that the sensor in the device detects thetaps and determines whether they correspond to an authorized temporalpattern. As still another example, the electronic device may detect thatit has been moved in a particular manner (e.g., shaken twice then spun)using a sensor in the device (e.g., an accelerometer or gyroscope). Inresponse to detecting a correct temporal pattern, the electronic devicemay provide access to restricted resources.

In some embodiments, the authentication system may combine temporal andvisual patterns for authentication. For example, a user may be requiredto select particular displayed shapes at a certain rate (e.g., the firsttwo shapes quickly, then a pause before simultaneously selecting thelast two). As another example, the user may be required to first selectthe proper shapes then provide an input for a temporal pattern. As stillanother example the user may be required to select one or more shapesand move the device (e.g., shake the device). Any other suitablecombination of inputs may be required for authentication.

The electronic device may set up visual or temporal patterns forauthorized users using any suitable approach. In some embodiments, whena user selects to use a temporal or visual pattern to restrict access toparticular device resources, the electronic device may direct the userto provide or select the temporal or visual pattern. For example, theelectronic device may provide a list of shape attributes that the usermay select to form a pattern (e.g., a color or a contour). As anotherexample, the electronic device may direct the user to select displayedshapes or provide a temporal pattern, and extract or identify thepattern from the received inputs. The electronic device may direct theuser to provide a pattern several times before it is accepted to ensurethat the user intended and remembers the selected pattern.

The electronic device may include any suitable number and types ofauthentication systems. For example, the electronic device may includeone, more or all of the authentication systems or authenticationapproaches described above. Access to different resources may berestricted using one or more authentication systems, which a user mayselect or set up. In some embodiments, several authentication systemsmay be used sequentially before access to particular restrictedresources is provided.

FIG. 15 is a flow chart of an illustrative process for authenticating auser in accordance with one embodiment of the invention. Process 1500may begin at step 1502. At step 1504, the electronic device may identifythe user of the device. For example, the electronic device may receive ausername or password associated with the user. As another example, theelectronic device may receive authentication information using anauthentication system and identify the user from the receivedauthentication system. The electronic device may automatically receiveauthentication information without requiring an express input from theuser, for example by placing a sensor of the authentication system in amanner that seamlessly captures authentication information as the useroperates the device. As another example, the sensor may be operative todetect features of attributes of the user as soon as the user is withinthe field of view or sensing region of the sensor. In some embodiments,process 1500 may move directly from step 1502 to step 1506.

At step 1506 the electronic device may determine whether a request toaccess restricted resources was received. For example, the electronicdevice may determine whether the user provided an instruction to accessdata associated with a particular user (e.g., a contact list or otherpersonal information). As another example, the electronic device maydetermine whether the user provided an instruction to access arestricted application (e.g., an application restricted to a particulartier of users, such as administrators, or an application purchased by aparticular user). If the electronic device determines that noinstruction to access restricted resources was received, process 1500may return to step 1506 and continue to monitor inputs received from theuser.

If, at step 1506, the electronic device instead determines that aninstruction to access restricted resources was received, process 1500may move to step 1508. At step 1508, the electronic device may determinewhether the identified user is authorized to access the resources. Forexample, the electronic device may determine whether the user hasprovided suitable authentication information for accessing therestricted resources. The electronic device may receive suitableauthentication information without the user's knowledge, for example byembedding an authentication sensor in the device such thatauthentication information is received during normal use. If theelectronic device determines that the identified user is not authorized,process 1500 may move to step 1510. At step 1510, the electronic devicemay instruct the user to authenticate. For example, the electronicdevice may direct the user to provide authentication information to anauthentication system (e.g., any of the authentication systems describedabove). In some embodiments, the electronic device may detect severalinputs by the user, and determine whether the inputs have a pattern orshare attributes associated with an authorized user (e.g., determinewhether the user has provided the proper inputs that correspond to anattribute or pattern of an authorized user, or determine whether theattribute or pattern of the inputs matches an attribute or patternassociated with authorized users). Process 1500 may then return to step1508 to determine whether the user has provided suitable authenticationinformation.

If, at step 1508, the electronic device instead determines that the useris authorized, process 1500 may move to step 1512. At step 1512, theelectronic device may provide the user with access to the requestedrestricted resources. For example, the electronic device may provide theuser with access to personal data or to applications specific to theuser. Process 1500 may then end at step 1514.

The above described embodiments of the invention are presented for thepurposes of illustration and not of limitation, and the presentinvention is limited only by the claims which follow.

What is claimed is:
 1. A electronic device, comprising: a display; anoptical sensor; at least one of an accelerometer or gyroscope; one ormore processors; and memory storing one or more programs configured tobe executed by the one or more processors, the one or more programsincluding instructions for: while the electronic device is in a lockedstate, detecting a plurality of inputs, wherein the plurality of inputsinclude: using the optical sensor to detect one or more facial or eyefeatures; and using the at least one of the accelerometer or gyroscopeto detect motion of the electronic device; and in response to detectingthe plurality of inputs: in accordance with a determination that theplurality of inputs meets authentication criteria, unlocking theelectronic device, wherein the determination that the plurality, ofinputs meet authentication criteria is based on: the motion of theelectronic device detected using the at least one of the accelerometeror gyroscope following a predetermined pattern; and the facial or eyefeatures detected using the optical sensor matching authorized biometricinformation; and in accordance with a determination that the pluralityof inputs do not meet the authentication criteria, displaying a userinterface that indicates that the electronic device is not unlocked. 2.The electronic device of claim 1, wherein the locked state is a state inwhich access to electronic device resources are restricted.
 3. Theelectronic device of claim 1, wherein the optical sensor is locatedadjacent to the display.
 4. The electronic device of claim 1, whereinthe optical sensor is operative to detect light reflected by one or moredistinctive features of a user's face when the user's face is placedopposite the optical sensor.
 5. The electronic device of claim 4,wherein the light reflected from a user's face is generated by a lightemitted by the electronic device.
 6. The electronic device of claim 1,wherein the electronic device further includes an authentication system,the authentication system including one or more countermeasures forpreventing spoofing of the facial or eye feature.
 7. The electronicdevice of claim 1, wherein the optical sensor is a webcam of theelectronic device that is used for chatting.
 8. The electronic device ofclaim 1, wherein the determination that the plurality of inputs meet theauthentication criteria is based on a user moving eyes in a manner thatmatches a predetermined eye movement.
 9. The electronic device of claim1, wherein the facial or eye features are captured in response todetecting that a user is within the field of view of the optical sensor.10. The electronic device of claim 1, wherein the determination that theplurality of inputs meet the authentication criteria is performed whilea user wakes the electronic device.
 11. The electronic device of claim1, wherein the user interface that indicates that the electronic deviceis not unlocked includes instructions for providing an input to unlockthe electronic device.
 12. A method comprising: at an electronic devicewith a display, an optical sensor, and at least one of an accelerometeror gyroscope: while the electronic device is in a locked state,detecting a plurality of inputs, wherein the plurality of inputsinclude: using the optical sensor to detect one or more facial or eyefeatures; and using the at least one of the accelerometer or gyroscopeto detect motion of the electronic device; and in response to detectingthe plurality of inputs: in accordance with a determination that theplurality of inputs meets authentication criteria, unlocking theelectronic device, wherein the determination that the plurality ofinputs meet authentication criteria is based on: the motion of theelectronic device detected using the at least one of the accelerometeror gyroscope following a predetermined pattern; and the facial or eyefeatures detected using the optical sensor matching authorized biometricinformation; and in accordance with a determination that the pluralityof inputs do not meet the authentication criteria, displaying a userinterface that indicates that the electronic device is not unlocked. 13.The method of claim 12, wherein the locked state is a state in whichaccess to electronic device resources are restricted.
 14. The method ofclaim 12, wherein the optical sensor is located adjacent to the display.15. The method of claim 12, wherein the optical sensor is operative todetect light reflected by one or more distinctive features of a user'sface when the user's face is placed opposite the optical sensor.
 16. Themethod of claim 15, wherein the light reflected from a user's face isgenerated by a light emitted by the electronic device.
 17. The method ofclaim 12, wherein the electronic device further includes anauthentication system, the authentication system including one or morecountermeasures for preventing spoofing of the facial or eye feature.18. The method of claim 12, wherein the optical sensor is a webcam ofthe electronic device that is used for chatting.
 19. The method of claim12, wherein the determination that the plurality of inputs meet theauthentication criteria is based on a user moving eyes in a manner thatmatches a predetermined eye movement.
 20. The method of claim 12,wherein the facial or eye features are captured in response to detectingthat a user is within the field of view of the optical sensor.
 21. Themethod of claim 12, wherein the determination that the plurality ofinputs meet the authentication criteria is performed while a user wakesthe electronic device.
 22. The method of claim 12, wherein the userinterface that indicates that the electronic device is not unlockedincludes instructions for providing an input to unlock the electronicdevice.
 23. A non-transitory computer-readable storage medium storingone or more programs configured to be executed by one or more processorsof an electronic device with a display, an optical sensor, and at leastone of an accelerometer or gyroscope, the one or more programs includinginstructions for: while the electronic device is in a locked state,detecting a plurality of inputs, wherein the plurality of inputsinclude: using the optical sensor to detect one or more facial or eyefeatures; and using the at least one of the accelerometer or gyroscopeto detect motion of the electronic device; and in response to detectingthe plurality of inputs: in accordance with a determination that theplurality of inputs meets authentication criteria, unlocking theelectronic device, wherein the determination that the plurality ofinputs meet authentication criteria is based on: the motion of theelectronic device detected using the at least one of the accelerometeror gyroscope following a predetermined pattern; and the facial or eyefeatures detected using the optical sensor matching authorized biometricinformation; and in accordance with a determination that the pluralityof inputs do not meet the authentication criteria, displaying a userinterface that indicates that the electronic device is not unlocked. 24.The non-transitory computer-readable storage medium of claim 23, whereinthe locked state is a state in which access to electronic deviceresources are restricted.
 25. The non-transitory computer-readablestorage medium of claim 23, wherein the optical sensor is locatedadjacent to the display.
 26. The non-transitory computer-readablestorage medium of claim 23, wherein the optical sensor is operative todetect light reflected by one or more distinctive features of a user'sface when the user's face is placed opposite the optical sensor.
 27. Thenon-transitory computer-readable storage medium of claim 26, wherein thelight reflected from a user's face is generated by a light emitted bythe electronic device.
 28. The non-transitory computer-readable storagemedium of claim 23, wherein the electronic device further includes anauthentication system, the authentication system including one or morecountermeasures for preventing spoofing of the facial or eye feature.29. The non-transitory computer-readable storage medium of claim 23,wherein the optical sensor is a webcam of the electronic device that isused for chatting.
 30. The non-transitory computer-readable storagemedium of claim 23, wherein the determination that the plurality ofinputs meet the authentication criteria is based on a user moving eyesin a manner that matches a predetermined eye movement.
 31. Thenon-transitory computer-readable storage medium of claim 23, wherein thefacial or eye features are captured in response to detecting that a useris within the field of view of the optical sensor.
 32. Thenon-transitory computer-readable storage medium of claim 23, wherein thedetermination that the plurality of inputs meet the authenticationcriteria is performed while a user wakes the electronic device.
 33. Thenon-transitory computer-readable storage medium of claim 23, wherein theuser interface that indicates that the electronic device is not unlockedincludes instructions for providing an input to unlock the electronicdevice.